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ABSTRACT 

This study is part of a continuing program of 
evaluation of open vs. traditional education at the jui^ior high 
school level. Incoming seventh graders vere assigned to open and 
control groups to evaluate relative effects on academic 
underachievement, socialization, and general academic ^success" as a 
function of various means of student selection. Initi^il^ midpoint, 
and final testing vill include measures of academic achievement, 
personality, attitudes, and socialization. The study uses a HANOVA 
(multivariate analysis of variance) random assignment model to permit 
definitive evaluation of some concepts of student selection for open 
education. (Author) 
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Multivariate Evaluation of Student Selection Strategies 
in Open and Traditional Education 

Allan \L Dornseif, Susan Gross, and Alan F. Sewe 1 ) 



The purpose of this report is to present conceptual considerations, 
design factors, and analyses of preliminary data of a study conducted through- 
out the course of the 1973-7^ academic year. A final report, based upon the 
full year's data, will be prepared at the conclusion of the study. 

In September, 1972, School District 16?, inaugurated a pilot program 
of open education at the junior high school level. A total of 1^0 seventh- 
and ei gitth-grade students were randomly assigned to a single, very large, 
newly constructed classroom staffed by four teachers and two teacher-aides. A 
similar number of students were randomly chosen and assigned to the school's 
traditional departmentalized program to serve as a control group. The origin 
and nature of the programs and student assignment procedures have been de- 
tailed elsewhere (Sewell S Dornself, 1973; Sewe 1 1 S Dornseif, 197^). 

Planning for evaluation of the open education program began well in 
advance of the program's inauguration. Evaluation plans focussed on two prin- 
cipal concerns: (1) determining the relative academic and soc t o-emot i ona 1 values 
of open education and traditional education, and (2) determining which rf the 
two types of programs was more appropriate to certain student characteristics. 
The first of these concerns was given priority in designing the initial evalua- 
tion model; that is, the objective of the first year's evaluation program was 
to determine whether student outcomes differed as a function of the type of 
educational program and, if so, whether these differences were positive or neg- 
at \ ve. 
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Data collected during and at the end of the program^s first year- 
showed no consistent pattern of superiorities for either the open classroom's 
students or students in the traditional (control) program; results are re- 
ported in detail elsewhere (Sewell & Dornseif, 197^"*. Certain of the findings, 
however, suggested that the open education program was, in effect, less "open" 
than had been anticipated or intended. Thus, while the second year's evalu- 
ation plan (1973^7^) is primarily concerned with identification of appropri- 
ate student types for each program, a portion of the first year's plan is be- 
ing continued into the second year. That is, outcome as a function of certain 
student characteristics is the major objective of the current study, but a 
secondary objective is continuing evaluation of the degree of "openness" in 
the program. 

Individualization of instruction Is a recurrent theme of publica- 
tions dealing with the theory and practice of open education (Walberg & 
Thomas, 1972). Admission of the very concept of individualization, however, 
suggests that open education is not necessarily the most appropriate educa- 
tional strategy for all individuals; indeed, some research data indicate that 
for at least some students the more structured, traditional approach is more 
suitable (T raub et a 1 . , 1973). Consideration of this possibility dictated the 
rationale, and to some extent the methodology, of the second year's evaluation 
plan. 

Various conceptualizations of open education are capable of nominating 
widely differing types of students as likely to benefit from open education: 
ranging from gifted children (who can more freely pursue their own objectives) 
to academic underach levers (who can benefit from the teacher's individualized 
attention), from socially extraverted children (who can function more freely 
in an open environment) to socially introverted children (whose social develop- 
ment will be furthered by experience in an open environment). Indeed, con- 
id 
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vincing rationales can be established for virtually any describable variety of 
student, (V/hether this fact reflects favorably or adversely upon the nature of 
open education theorizing is moot,) It is obviously impossible to consider all 
possible student varieties in assessing the effects of a single program; hence 
the present study is concfirned with relatively small numbers of limited vari- 
eties. 

Because the first yearns study had indicated that students generally 
succeed as well (in the academic sense, at least) in the open education program 
as in the t radi 1 1 ona I p rogram, eva 1 uat i on i n te res t was d i rected towa rd non- 
academic student characteristics. Social and motivational characteristics were 
of primary interest, and the groups to be followed during the year were ulti- 
mately Identified as an "introvert" group, an "extravert" group, an "under- 
achievement" group, and a "teacher-nominated" group. The general strategy of 
the evaluation involved both academic and non-academic progress of the students 
as a function of type of academic program. Simultaneously, the relative open- 
ness of the programs would be assessed. 

Method 

Content and organization of the open and traditional programs, and the 
physical settings in which they are conducted, remain essentially similar to 
those of the previous year (for details, see Sewel 1 S Dornseif, 1973, 197^). 
Seventh-graders of the 1972-73 year are, of course, now eighth-graders; of the 
original group of 70 then-seventh grade students, a number have been lost as a 
result of family relocations or withdrawal from the program; although these have 
been replaced in the classroom, they have not been replaced in the study. That 
is, data reported here as derived from current eighth-graders were produced only 
by students who have been continuously enrolled in the program (whether open or 
traditional) since the beginning of the 1972-73 year, 

O 
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Student Selection Strategies — Seventh Grade 

As in the previous year, 70 incoming students of the junior high 
school were to be assigned to the open classroom. (In this District, students 
attend local primary schools through the sixth grade and then are transferred 
to the District's 5 i]e Upper Grade Center for seventh and eighth grades.) 
For the previous year's enrollment, these students had simply been chosen at 
random from a poo! of approximately kOO students derived from fourteen sixth- 
grade classrooms distributed among the District's seven primary schools, except 
that boys and girls were to be equally represented in the sample, and each pri- 
mary school was to be proportionately represented in the sample. 

Because the second-year evaluation was intended primarily to focus on 
the relative effectiveness of assignment strategies, a more complex and sub- 
jective assignment procedure was devised. The fourteen sixth-grade teachers 
were assembled, and the basic objectives and operations of the open classroom 
were described to them by the evaluation staff. Each teacher, working from his 
own class list and on the basis of personal knowledge of the student, was asked 
to identify students according to the following grouping criteria: 

1. Academi c unde rach i evemen t : "IQat least average (100), but achieve- 
ment scores less than 45th centile in at least three subtest areas." 

2. Social i nt rove rs i on : "This student is mainly interested in hob- 
bies, tasks, and objects. He or she is often alone or with only one friend. 

He or she would rather be a participant than a leader and usually responds only 
when spoken to. This student is generally quiet In class." 

3. Social extraversion : "This student seeks social contact and has 
an interest in people. He or she is often with a group of peers or several 
friends. He or she tends to be a leader or seeks a leadership role and often 
initiates projects and ideas. This student tends to be quite verbal in class." 

Teacher nomi nat ion : On the basis of their understandings of the 

O 
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differences in concepts and methodologies of the open classroom and the tradi- 
tional program, teachers were asked to nominate students who, in their opinions, 
would function best in each learning environment. 

5- Random ass i gnment : Students not identified for any of the pre- 
ceding groups constituted a poo) from which individuals would be randomly as- 
signed to the open classroom and the traditional program; members of this group 
were intended to serve as controls for members of other groups. 

Except for the "social introversion" and "social ext ravers i on" groups, 
teachers were asked to nominate all students in their classes who met the cri- 
teria provided. To obtain the greatest subjective distinctions between "intro- 
verts" and "ext ravert s ," the teachers were asked to identify the two students 
(one male, one female) who best met the criteria for each category. 

In this manner, all sixth-grade students were assigned to one (and only 
one) of five pools from which assignments to the open classroom group and a 
traditional program control group could be made. Obviously, the largest of 
these pools was the ^'random assignment" poo!. 

Since only 70 students were to be assigned to the open classroom (and 
a similar number to the traditional program control group), dividing these 70 
places among the five subgroups of interest was a severe problem, which, ulti- 
mately, had to be resolved on a largely subjective basis. Results of the pre- 
vious year's study had revealed two areas of particular evaluative interest: 
academic achievemcint and sociability. It appeared that students in the open 
classroom fared as well as their traditional program counterparts in academic 
achievement; indeed, in some academic areas the open classroom students were 
significantly superior at the end of the year. There were indications, however, 
that the academic achievements of the open classroom group were made at some 
cost in self-concept and sociability. Since the previous year's students had 
all been randomly assicied, no special attention had been paid to underachieving 
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students; but it was hypothesized that the open classroom's provision for more 
individualized instruction (at least in theory) might well be especially advan- 
tageous to underachievers. A generally similar line of reasoning led to hypo- 
theses of differentia] effects of the two educational programs upon "intro- 
verts" and "extraverts." Major allocations of student positions were, there- 
fore, made to the first three of the five groups. A lesser number of students 
was allocated to test teachers' abilities to recommend student-appropriate edu- 
cat i ona I p rograms. 

Allocations to groups within the two programs finally were devised as 

fol I ows : 





PROGRAM 


Open 


Trad i t i ona 1 


GROUP 


Male 


Fema 1 e 


Male 


Fema 1 e 


Underach I evement 


9 


10 


f3 


10 


1 nt rovers i on 


5 


7 


3 


7 


Ext rave rs ; on 


8 


7 


7 


7 


Teacher nomination 


8 


6 


5 


7 


Random ass i gnment 


k 


7 


2 


k 


Tota 1 


3k 


37 


35 


35 



Preliminary data indicate that significant results of analyses can be 
demonstrated despite the small number of students in these subgroup i ngs . 

Teachers in neither program were informed of the bases of assignment 
of new students. For purposes of this research, each student has been assigned 
a distinctive code number to Identify him, his program and subgroup, sex, and 
grade level. Identifiable raw data are never made available to persons out- 
side the evaluation group, and preliminary results have not been communicated 
to other school personnel. 

O 
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Measures and Instruments 

As noted previously, the two purposes of the present study are: (1) 
to monitor the relative openness of the open classroom program, (2) to deter- 
mine the differential effects of the two types of programs for students in the 
various subgroupings of each program. The first year's evaluation study had 
shown little program effect at midterm; a pattern of significant and meaning- 
ful effects did not emerge until the fina), end-of-year testing. Furthermore, 
both teachers and students objected to the frequency of test administrations 
during the first year, and it was decided to limtt testing as much as possible 
during the present study. For these reasons, little effort has been made to 
obtain student-outcome measures at the midterm point. 

Instead, primary evaluation attention has been devoted to measures of 
the nature of the open classroom program itself. The difficulty of measuring 
degree of openness has been extensively considered elsewhere (Sewell & Dornself, 
197^), but the previous year's study has provided ai indirect measure which was 
both conceptually satisfactory and statistically useful: teachers' ratings of 
student "success." 

This technique does not actually require teachers to rate each student 
as "successful" or "unsuccessful." Each student is, instead, assigned a numer- 
ical rating (on a five-point scale) In each of four areas which are defined as 
f o I lows : 

At t I tude : Student displays positive attitudes toward school, teachers, 
other school personnel, and other students. 

Knowledge : Student demonstrates mastery of academic content appro- 
priate to his/her age, grade level, and apparent ability. 

Skill : Student demonstrates application of academic content within 
school and displays ability to apply academic content in non-academic settings. 

Sociabi 1 i ty : Student demonstrates respect for the rights and feelings 
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of others and demonstrates ability to work effectively and cooperatively with 
others. 

Teachers are asked to vate each chi Id i ndependent ly in each of the 
four designated areas and Independently of other students. Low ratings desig- 
nate below average performance, while high ratings indicate above average per- 
formance; and the teachers are informed that the "average" here is not limited 
to the students being rated but is intended to refer to the average of all stu- 
dents known in the teacher's career. 

This student- rat i ng method had been followed at the end of the first 
year (1972-73) study; all open classroom and all control group students were 
rated. Hence previous ratings for the current eighth-graders were available. 
At about the middle of the second year (1973-7^) study, teacher ratings were 
secured for all current students of the open classroom program, but not for con- 
trol group (traditional program) students. 

Each open classroom teacher's ratings were converted into a single 
z distribution to avoid problems which might be caused by differences in use of 
the scale values. The result was a single _z rating of each child by each 
teacher, or a total of four such ^ ratings for each child. These four ratings 
were then combined to yield a single mean _z rating for each open classroom 
student, and this single rating can be considered as a measure of the student's 
"success." (in the previous year's study, "success" was arbitrarily defined 
as a mean ^ rating above the group's median, and "failure" was defined as a 
mean _z rating below the group's median; these distinctions, however, were not 
necessary at this stage of the present study.) 

The rationale for use of teacher ratings as a method of assessing pro- 
gram openness (or, in fact, any other program characteristic) argues that the 
teacher is in effect defining the objectives of the program in identifying 
"successful" and '^unsuccessf u P* students; the respective characteristics of 
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those students reflect the positive and negative criteria of the program. It 
can be argued, for example, that if profiles of "successful" students in tv^o 
putatively different programs do not significantly differ, then the objectives 
of the teachers in the two programs do not differ, and, therefore, the two pro- 
grams do not differ. (Such, in fact, was the finding and conclusion of the 
first-year evaluation.) 

Another approach to evaluation of program openness was also adopted 
for this preliminary evaluation. Whereas teachers' ratings of students pro- 
vide the teachers' perspectives of the program, the students' perspective is no 
less important. To obtain this perspective, the Learning Environment Inventory 
developed by Walberg and Anderson (Anderson, 1973) was administered to all 
students In the open classroom and to all students in the traditional program 
control group. This instrument consists of 105 statements to which the stu- 
dent responds on a four-point agree-di sagree scale. Scores on fifteen scales, 
each based on seven items, arfj obtained. Each of these scales presumably re- 
flects a different aspect or characteristic of the classroom env i r"onment , Dif- 
ferences in educational programs should then produce statistically and con- 
ceptually different profiles. 

Capacity limitations of the computer available for processing these 
preliminary data necess i tatejd elimination of one of the seven-item scales of 
the Inventory. Because its reported reliability was lowest, the "Diversity' 
scale was not included in analyses, although the students did indeed complete 
the items of that scale. Otherwise, all ad.ni n i st rat i on and scoring recommend- 
ations were followed. 



Resul ts 

report only results obtained through the two eval- 
wi 1 I be reported: analyses of teachers' ratings 
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and analyses of Learning Environment Inventory data. The final report of the 
second-year study will include more extensive and more detailed student-outcome 
analyses. 

Analyses of Teachers' Ratings 

Although all four of the open classroom teachers were asked to provide 
student ratings, only three of them complied. One teacher (the science teacher), 
apparently objecting to either the procedure or the request, returned his stu- 
dent list with virtually the same ratings for all students. Since these ratings 
were intended only for preliminary evaluation, no attempt was made to obtain 
new, more variable ratings from the teacher. His ratings, however, were in- 
cluded in calculations of the mean ^ ratings and had the general effect of add- 
ing a constant; that is, his ratings did not distort the effect of the other 
teachers ' rat i ngs , 

Use of the Rating Scales. Several questions of interest can be raised 
about the way teachers use the four scales upon which each student was rated. 
Pearson product-moment correlations were calculated between each of the six- 
teen ratings of each student (four ratings by each of four teachers), but as 
noted above, lack of variability in one teacher's ratings render many of the 
intercorrelat ions meaningless. Examination of the patterns of intercorrela- 
tions within each teacher's ratings (for example, the correlation between the 
social studies teacher's ratings on the Attitude and Knowledge scales) sug- 
gest? that the four scales more clearly represent two factors; a kind of "so- 
cial" factor (including the Attitude and Sociability scales), and a kind of 
"academic" factor (incl udi ng the Knowledge and Skill scales). The highest in- 
tercorrelat ions always occur between Knowledge and Skill ratings, ranging from 
.760 to .9^5; intercorrelations between Attitude and Sociability ratings are 
more modest, ranging from .700 to .795. 



These wi thin-teacher correlations are always hi3her than between- 
teacher correlations, even cn the same scale. On the Attitude scale, the mean 
of the three teacher correlation coefficients is .657; on the Knowledge scale, 
.656; on the Skill scale, .665; and on the Sociability scale, .57^. That is, 
each teacher's perceptions of the student are fairly consistent across rating 
dimensions, but the teachers do not as strongly agree with each other in rating 
a child, even within a single rating dimension. 

This finding recommends use of a single rating by each teacher, and, 
indeed, just such a single rating was the result of constructing each teacher's 
z distribution. Hence for each teacher a single^ rating was calculated for 
each student, a rating which was compounded of the teacher's four separate 
ratings of that student. 

Homogeneity of the Program. The rationale of an open classroom staffed 
by four teachers certainly implies behavioral consistency among the teachers. 
While behavioral consistency may be evaluated in various ways (for example, 
by means of observation schedules, se 1 f- reports , etc.), most of these tech- 
niques are difficult to employ, unreliable, or excessively subjective. On the 
other hand, the teachers' ratings of students provide a simple and conceptually 
satisfying way of estimating program homogeneity. 

Working together, cooperatively, over a period of time, teachers 
should gradually adopt perspectives which they can share; that is, a common con- 
ceptual framework should gradually emerge, whether this be done deliberately or 
unconsciously. Presumably this framework should be evident in the behavior of 
all the teachers, and it should manifest itself in similar beliefs about and 
evaluations of their students. By way of contrast, another set of teacher*^, 
each working in isolation, would be more likely to have more divergent views of 
a common group of students, since the view of each teacher would be formed in 
response to his individual experiences with the student. In a traditional. 



departmentalized program, for example, there would be little reason to expect 
correlations of ratings of students by a language arts teacher and a science 
teacher greatly to exceed the correlations of the subject matters themselves. 

In a negative sense, low Intercorrelations of teacher ra tings within 
the open classroom program would provide strong evidence of program hetero- 
geneity, a lack of common viewpoint. High intercorrelations would, of course, 
not specify the nature of a common viewpoint, but it would Indicate that such 
a viewpoint exists. Intercorrelations of _z ratings by the three teachers whose 
ratings were usable are as follows: language arts and social studies, .700; 
language arts and mathematics, .724; social studies and mathematics, .768. 
These correlations are agreeably clustered, and they are substantially higher 
than those obtained in the previous year's study. 

Correlates of Teachers' Ratings 

The first-year study had Indicated that ratings by teachers were sub- 
stantially correlated with both sex and grade level, such that girls received 
higher ratings than boys, and seventh-graders received higher ratings than 
eighth-graders; indeed, the most "successful" students (those receiving the 
highest ratings by open classroom teachers) were seventh-grade girls. Other 
data suggested that passivity and academic ability were underlying sources of 
these ratings, thereby Implying that the teachers' criteria of "success" were 
not particularly consonant with the theoretical objectives of open education. 

Similar analyses were conducted with the teachers' current ratings of 
open classroon students. The poi nt-bi se r i a 1 correlation between rating and 
grade level was now found to be .181, while that between rating and sex was 
found to be .195. Considering only eighth-grade students, the pol nt-bi serial 
correlation between rating and sex was found to be .397, while that between 
rating and sex at the seventh-grade level was .052. Hence it appears that nel- 
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ther sex nor grade level is any longer a significant associate of '^success*' in 
the open classroom. 

Because the eighth-grade students \^ad been rated near the end of the 
first-year study, it was possible to evaluate the consistency over time of 
teachers' ratings. The Pearson product-moment correlation coefficient between 
ratings provided approximately six months apart was .882. Although as noted 
above, rating and sex were on Ky moderately correlated in this group, males con- 
tinue to be rated significantly lower than females. At the end of the first- 
year study, the mean ^ rating for males was -.338 and for females was .570; 
the current mean ^ ratings are -.40U for males and .kkl for females. Ratings 
of both males and females, it should be noted, are currently (but not signifi- 
cantly) lower than previously. 

Subgroup Patterns of Teachers* Ratings 

Seventh-grade students assigned to the open classroom had been, as 
previously noted, allocated to five subgroups. To determine whether teachers' 
ratings of students varied as a function of subgrouping characteristics, mean 
ratings for each group were calculated; since sex is essentially uncorrelated 
with rating (among the seventh-graders), a single mean for each subgroup was 
determi ned. 

The mean rating for the Academic Underachievement subgroup was -.179 
(N = 19); for the Introversion subgroup, -.7^5 (N = 12); for the Extraversion 
subgroup, ,420 (N = 15); for the Teacher Nomination subgroup, .203 (N = ]k) ; 
and for the Random Assignment subgroup, -.027 (N ~ 11). One-tail ^ tests of 
differences between these means showed significance for the I nt rovcrsion- Extra- 
version means (^ = 5.271, _df = 25, £<.00l), and for the Ext raver ion- Random 
Assignment means (^ = 1.977, df^ = 24, .05). In both cases, of course, the 
Extraversion subgroup members were more highly rated. 
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These findings suggest that, with respect to the seven th- graders at 
least, the teachers' rating criteria are currently associated more closely 
with patterns of leadership and social behavior described in the assignment 
protocol, and that contrary patterns cf behavior lead to significantly lower 
general ratings. 

Learning Environnient Inventory: Hpen vs. Control 

Ratings of students by the teachers provide some understanding of the 
teachers' perspectives of the open education program. The other instrument em- 
ployed in this preliminary study was used to evaluate the program from the stu- 
dents' perspectives. This instrument, the Learning Environment Inventory (LEl), 
was administered to afl available members of the open classroom group and all 
members of the traditional program (control) group in group sessions. Students 
In both groups were instructed to complete the inventory with respect to their 
language arts classes, rather than with respect to their academic programs as 
a whole; this potential limitation should be considered in reviewing the re- 
sults. 

Because the eighth-grade and seventh-grade groups in both programs were 
assigned to their programs on different bases, results will be reported for each 
grade separately. And because these results are predicated upon preliminary 
data, they wi 1 1 be summarized rather than presented tabularly. Furthermore, 
the basic analytic technique employed here is that of the^-test, which, fail- 
ing to take into account patterns of i n te rcor re I at i ons between scales of the 
LEI, may provide somewhat distorted results. More appropriate multivariate 
analyses will be applied to data derived from a year-end administration of the 
LEI. Nevertheless, it seems likely that the general patterns of results re- 
ported here can be defended. 

Eighth Grade. Three of the fourteen LEI scales significantly differ- 



ed 
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entlated the open classroom grouD from the control group: Goal Direction (t = 
L941, df = 10), £<,05), Satisfaction (t = 2,709» df = 101. p<.005). and 
Competitiveness = 1.9^2, _Jf= 3 01, p<.05). In each case, an 1 y oi-e- 1 a i ) 
tests were performed, since the directionality of expected differences could 
be theoretically derived. The pattern of these results suggests that the open 
program Is more individualized and more satisfying than the traditional pro- 
gram. 

Seventh Grade. The pattern of results for the seventh-grade groups 
is more complex. A summary appears in the following table. 



SCALE 


OPEN (N=64) 
Mean 


TRADIT 1 ONAL 
Mean 


(N-65) 

t 


Cohes i veness 


!5. 


,078 


15.738 


2.01 8-.'.-.'.- 


Forma 1 i ty 


!9. 


,500 


20.292 


2.206'.-'.- 


Speed 


15. 


266 


16.769 


3.13 7-,v-;.-;.- 


Env i ronmen t 


19. 


766 


18.55^ 


3.014--V..--.V 


Fr i ct i on 


10. 


359 


1 1 . 138 


2.033----- 


Goa 1 D i rect i on 


1^. 


73^+ 


15.415 


1.673-'- 


Favour! t i sm 


16. 


297 


1 7.600 


2.258-.'-.'.- 


Difficulty 


10. 


672 


10.892 


NS 


Apathy 


17. 


266 


16.923 


NS 


Democ rat i c 


16. 


^►53 


! 5 . 846 


NS 


C) i queness 


17. 


266 


17.908 


1 .739-- 


Sat i sf act i on 


23. 


188 


2 1 . 646 


3.779.V---; 


D i sorgan i zat i on 


15. 


016 


14.933 


NS 


Compet i t i veness 


18. 


219 


18.000 


NS 


•••-£<. 05 


£<.025 


••••■£ < .005 


■•■•-.■-'-•■-p < ,0005 



All of these differences are in the directions predictable from open education 
theory. 



Learning Environment Inventory: Seventh Grade Subgroups 

While it is clear that as a vjhole seventh-graders in the open educa- 
tion program perceive their learning environment differently and more favorably 
than their counterparts In the traditional program, data are available to an- 
swer other questions of interest. The first of these concerns whether there are 
patterns of open program - traditional program differences specific to each of 
the seventh-grade subgroup i ngs . Each open program subgroup was compared to its 
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counterpart in the traditional program on each of the LEI scales. Again, 
somewhat i napprop r i ate _t- test s were performed, and significance levels for 
one»tai 1 tests are reported. Results for each subgroup are reported separately 
below; only those scales which significantly differentiated the open program 
and traditional program subgroups are noted. 

Academi c Underach 1 evement Subgroup. The open program and traditional 
program subgroups differed on two scales of the LEI: Speed (_t = 1.707, _df = 
37, P^ .05) and Sat isfact ion (t = 3.735, df = 37, P < .0005) . The open program 
students see their program as unhurried, and they are more satisfied with the 
program. 

I nt rove rs r on'^ Subgroup . Four scales differentiated these subgroups 
in the open and traditional programs: Speed (_t = K 769, d^ = 23, p<.05). 
Environment (_t = 2,27S, df = 23. P< .025), Satisfaction (t = 2.331, = 23, 
£ <'.025) , and Di sorgen i zat i on (jt = 1 . 93 7 , df = 23 , p < . 05) . As compared to 
the control subgroup, the open program students view their program as less 
rushed, disorganized, and confused; like and enjoy their physical environment; 
and are more satisfied v^ith their program, 

"Ext ravers i on" Subgroup . Here, too, four scales differentiated the two 
subgroups: Cohesiveness (jt = 2.085, df = 2k, £<.025), Speed {t = 2.908, _df = 
2k, £ <.005) , Friction (jt = 3-75^, ^ = 2^, £< .0005) , and Satisfaction (jt = 
3.022, _df = 2ky £<.005). The open program students are less cohesive as a 
group, a phenomonon probably related to individualization of instruction and 
greater emphasis upon individual goals as opposed to group goals. They, too, 
view their program as less rushed and marked by less interna) tension and fric- 
tion. They are more satisfied than their traditional program counterparts. 

Teacher Nomination Subgroup. Three scales distinguished between the 
open program students and the traditional program students in this subgroup: 
Speed (Jt = 2.125, df = 22, £< ,025), Goal Direction (t = 1.762, d[f = 22, £ <.05), 
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and Favouritism (t = 1.826, _df = 22, p^.05)* The open program students view 
their program as less rushed, less directed toward group goals, and less marked 
by favoritism tovviard brighter or otherwise special students. 

Random Assignment Subgroup. Comparisons of these subgroups were not 
conducted because of the very small number of students in the traditional sub- 
group . 

Learning Envir-onment Inventory: Assigned vs. Random Subgroups 

A second question of considerable interest is whether effective bases 
for assigning subgroupings were established. Comparisons of open classroom 
subgroups with their control counterparts, as noted above, demonstrate with 
reasonable clarity the nature and magnitude of differences in the two educa- 
tional programs, but these comparisons reflect little upon the validity of the 
subgroupings themselves. The purpose of the Random Ass i gnment subgroups within 
the two programs was to permit w i t h i n-p rog ram comparisons to test the validity 
of the other assignment criteria; that is, within each program significant dif- 
ferences should be found between each of the specific assignment subgroups and 
the Random Assignment subgroup. Unfortunately, the small size of the Random 
Subgroup in the traditional p rogram prec 1 udes meaningful comparisons, but the 
Random subgroup within the open education program is sufficiently large (N=10) 
to justify wi th I n-p rogram comparisons. 

Differences in LEI scales are clearest in the "Ext rave rs i on" vs. Random 
Assignment subgroups. Three scales differentiated these subgroups: Speed (t = 
1.9^0, df = 21, p< .05), Friction (_t = 2.377, ^f = 21, p<.025), and Satisfac- 
tion {t = 2.3:^9, df = 21, p<.025). 

Two LEI scales differentiate the "Introversion" and Random Ass i gnment 
subgroups: Speed = 1 .752, ^ = 19, £< .05) , and Disorganization U = 2.6^3, 
df = 19, p<-025). 
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Students in the Teacher Nomination subgroup differ from students In 
the Random Assignment subgroup on only a single scale: Goal Direction (_t = 
i,7^^, _df = 19, _p<.05). The Acaden.ic Unde rach t evemen t subgroup did not dif- 
fer from the Random Assignment subgroup on any scale. 

In each case of significant scale differences, the direction of the 
difference favored an open education or individualization interpretation. Thus, 
fo r examp 1 e , the mean of the " ! n t rove rs ion'' subgroup for the Disorganization 
scale was lower than the mean of the Random Assignment subgroup; the former, 
then, perceived less d i sorgan i z^.t i on of the learning environment than the lat- 
ter. The general pattern of results of these analyses suggests that the "Ex- 
traversion" and "Introversion" subgroups are the most distinctive (at least 
within the open education program), and the Academic Unde rach i evement subgroup 
IS the least distinctive. 

Di scuss i on 

The results of these limited, preliminary analyses are generally 
gratifying, particularly in comparison with the findings of the first-year study. 
There appears to be a reasonably clear documentation of teacher objectives and 
student perceptions conceptually consonant vjith open education. 

At the end of the first year's study, data analyses showed that the 
open program teachers rated most highly those students v;ho demonstrated super- 
ior academic achievement and whose personality structures vjere characterized 
by quietness and docility. These findings strongly Indicated that the teachers' 
objectives did not significantly differ from those of teachers in the tradi- 
tional program. Preliminary data of the current year's scudy, however, show a 
substantial departure from at least some of the previous year's objectives; now 
extraverted and gregarious students are most highly rated. Whether this ap- 
parent shift in teachers' objectives has been achieved at the expense of academic 
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accomplishment cannot be determined at this point; tests of academic achieve- 
ment will not be administered until the end of the current year. The strong 
emphasis within the entire district upon academic ach i evement / however , makes 
it unlikely that the teachers would sacrifice academic achievement for social 
goals. What seems more likely at this point is that the teachers have simply 
expanded their objectives to include social goals of education. 

Analyses of s t uden t- der i ved data are similarly gratifying. Students 
in the open classroom clearly perceive their learning environment as less 
structured, more individualized, less tense, and more satisfying than students 
in the traditional program. This pattern was not evidenced at the end of the 
first year's study, and it seems to parallel changes in teacher objectives. 
It should be emphasized, however, Lhat traditional program students do not per- 
ceive their environment as adversely structured, excessively tense, or unsatis- 
fying: in all cases scale means differed significantly and in the favorable 
direction -- from the theoretical means of the scales. That is, the traditional 
program students do not view their learning environments negatively; rather, 
the open classroom students view their environments more positively. 

Approval of the environment of the open classroom is not limited to 
particular subgroupings of students. Indeed this approval is clearest when 
subgroupings are ignored; hence the environment is accepted by and acceptable 
to all currently included varieties of students. When the subgroupings are con- 
sidered, however, clearest approval is given by the " Ext ravers i on" and "Intro- 
version" subgroups, again supporting the view that teachers' objectives have 
been expanded to include more social goals of education. Oddly, despite the 
fact that teachers rate "introverts" most negatively, these students quite 
strongly approve of their learning environment. Least differentiated of the 
subgroups, in both teachers' ratings and students' perceptions of the environ- 
ment, are the Academic Underachi evement , Teacher Nomination, and Random Assign- 
id 
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ment subgroups. This finding, how/ever, is rendered understandable when the 
strong influences of social and personality factors in both of the measures em- 
ployed in this preliminary study are considered. It well may be that sharper 
differentiation will occur when academic achievement and other variables are 
considered in the year-end study. 

The findings of the present study strongly support the belief that 
"openness" had not been achieved during the open education program's first 
year, and that the first-year's study had largely been an evaluation of a "non- 
event" (Charters & Jones, 1973). As these authors point out (p. 5), "There 
are certainly circumstances in which differences between what researchers re- 
gard as 'experfmenta P and 'control' programs are more fictional than factual, 
but in the absence of a measurement technology or tradition, such circumstances 
may well go undetected." Probably more often than not, such has been the 
character and the fate of open education programs. While educational theorists 
and practitioners seem to have emphatic (and frequently contradictory) notions 
of the nature of educational "openness," more frequently than not "openness" 
is achieved more by fiat than by thoughtful planning, careful implementation, 
and clearsighted evaluation. At least as important as the p roduct s of an edu- 
cational program (student outcomes, for example) is the determination of the 
nature of the program. And at least as important as the evaluative results of 
this study is its methodology, vjhich suggests ways in which program objectives 
can be determined in a clearer functional sense thari through the use of paper- 
and-penci 1 Instruments which seem all too often to bear little relation to 
classroom real i ty . 
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